Partial annealing of a coupled mean-field spin-glass model with an embedded pattern 
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A partially annealed mean-field spin-glass model with a locally embedded pattern is studied. 
The model consists of two dynamical variables, spins and interactions, that are in contact with 
thermal baths at temperatures Ts and Tj, respectively. Unlike the quenched system, characteristic 
correlations among the interactions are induced by the partial annealing. The model exhibits three 
phases, which are paramagnetic, ferromagnetic and spin-glass phases. In the ferromagnetic phase, 
the embedded pattern is stably realized. The phase diagram depends significantly on the ratio of two 
temperatures n = Tj/Ts- In particular, a reentrant transition from the embedded ferromagnetic 
to the spin-glass phases with Ts decreasing is found only below at a certain value of n. This 
indicates that above the critical value n c the embedded pattern is supported by local field from a 
non-embedded region. Some equilibrium properties of the interactions in the partial annealing are 
also discussed in terms of frustration. 



PACS numbers: 



'.20.-a, 75.50.Lk 



I 

c 

O 
o 



> 

m 
in 



X 



I. INTRODUCTION 

Spin-glass (SG) models 0, [2] have been extensively ap- 
plied to widespread fields for describing random or ran- 
domized spin systems. In such a system, there are two 
dynamical variables, fast and slow variables that are spins 
and interactions in a spin model, respectively. The lat- 
ter is usually assumed to be quenched for simplicity, and 
is distributed independently and identically according to 
a given distribution. This is based on the fact that the 
relaxation time of the interactions is considerably larger 
than that of the spins. As a result of the quenched ran- 
domness, the state of the interactions is not affected at 
all by the fluctuation of spins. The randomness of the in- 
teractions causes many competitions between the spins, 
and sometimes there is no way for eliminating them com- 
pletely. This competition that is called frustration pro- 
vides rich and interesting phenomena in the random sys- 
tems. 

The quenched randomness is an appropriate assump- 
tion for a spin-glass problem as a magnetic material. In 
some interesting systems, however, the fluctuation of the 
spin variables has large influence on the interaction vari- 
ables. For example, the interactions of ammo-acid se- 
quences provide a globally stable state in the protein. 
The existence of such global attraction in the folding pro- 
cess was proposed as a consistency principle Q or funnel 
landscape [J . The characteristics of interactions are not 
expected in randomly constructed interactions. It is sup- 
posed that such characteristics are acquired through an 
evolutional process under some fluctuations of the fast 
variables. In the case of the protein, the fluctuation is 
due to the folding dynamics of the amino-acid sequences. 
Similar properties have also been discovered in gene regu- 
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latory networks @ and transcriptional networks [f| . The 
formation mechanism of the funnel landscape is still not 
fully understood. 

Recently, an adiabatic two-temperature spin model has 
been studied as a model of evolution by using Monte 
Carlo simulations 0, In the model, interactions 

evolved so as to increase the probability of spins to find 
a specific pattern of local spins. Interestingly, adapted 
interactions that exhibit funnel-like dynamics with some 
robustness have been found only in an intermediate tem- 
perature region. This type of interactions has no frustra- 
tion around the local spins and retains some frustrations 
in the rest. The fact implies that the local spin pat- 
tern is stabilized in the adapted interactions by energetic 
and entropic effects. Note that there is no explicit driv- 
ing force for constructing interactions outside the local 
spins. Unfortunately, since numerical simulations are of- 
ten hampered by finite-size effects, thermodynamic prop- 
erties and phase structure have not yet been understood 
well. We consider it worthwhile to clarify the nature of 
such self-organized interactions with an local spin pat- 
tern under the thermal fluctuations from the viewpoint 
of a statistical-mechanics. 

In contrast to the quenched system, a feedback from 
the fast variables to the slow ones is taken into account 
for studying such systems. The feedback effect is essen- 
tial for the emergence of some functional feature in the 
evolutional process. Under the assumption of the com- 
plete separation of time-scales between the fast and slow 
variables, the adiabatic elimination of fast variables has 
been employed in non-equilibrium and non-linear physics 
[tl [Toll. One of such approaches, called partial anneal- 
ing [Tl|, is introduced by Penney et. al. in which 
the fast and slow variables touch with different heat 
baths and a non-equilibrium system is mapped onto a 
particular equilibrium statistical-mechanical system with 
two temperatures. The partial annealing approach has 
been applied to many topics; a model of glasses [Hj], 
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FIG. 1. (Color online) A schematic representation of a cou- 
pled mean-field spin-glass model. Spins and interactions are 
denned on vertexes denoted by circles and edges between ver- 
texes, respectively. Three triangles represent index of frustra- 
tion parameters, discussed in Sec. IIII CI 
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In this paper, we study a coupled mean-field spin-glass 
model [21[ in the partial annealing. In this model, two 
fully-connected mean-field systems are coupled with each 
other through spin-glass interactions. One of them is a 
ferromagnetic system regarded as a local region in which 
a ferromagnetic pattern is embedded. The other is a spin- 
glass system providing redundant interactions together 
with the coupled interactions. We formulate the mean- 
field theory for this model in partial annealing and dis- 
cuss how the redundant interactions are modified by the 
thermal fluctuation of spins. 

This paper is organized as follows. In section [TTl we 
introduce a mean-field spin-glass model studied in detail 
and give a theoretical formulation of the model in the 
partial annealing by using the replica method. In section 
III! we present phase diagram of the model and discuss 
the equilibrium state of interactions through frustration. 
Finally, section HVl is devoted to conclusions and outlook 
for further developments. 



II. MODEL AND REPLICA METHOD 

We study a coupled mean-field spin-glass model of two 
fully connected spin systems, which consists of N\ Ising 
spins = 1, • • • , Ni) and N 2 Ising spins {S2,i}(i = 

1, • • • ,N2). The spin variables of the two systems and 
the interactions between two spins are denoted by S and 
J for short, respectively. The Hamiltonian of the model 



is given by 



H(S\J) 



^ ^ Jp,ij Sp,iSp,j J3,ijSl,iS2,j, 

p=l i<j ij 



(1) 



where the summation in the first term is over all pairs 
within each spin system and the summation in the sec- 
ond term is over all i and j. {Ji.ij} and {J2,ij}, de- 
noted hereafter by J± and J 2 , respectively, are the intra- 
intcractions within each system and {Js,ij\ denoted by 
J3 are inter-interactions between these two systems. A 
schematic picture of the model is shown in Fig. [TJ In a 
quenched system, they are assumed to be independently 
and identically distributed according to the Gaussian dis- 
tribution with mean Jq, p and variance J p , 
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where the order of interactions J p ^j is scaled as N p for 
keeping the Hamiltonian extensive and A3 is set to be the 
geometrical mean of Ni and A^ as A3 = y/NiN 2 (2lj . 

In this paper, we consider that an ordering pattern 
is embedded in one of the system (system 1) and no a 
prior pattern is introduced in the other system (system 
2). This is represented by a specific case of the model 
Hamiltonian, in which the system 1 and the system 2 are 
a pure ferromagnetic and spin-glass systems, respectively, 
and they are coupled with each other through spin-glass 
interactions. Explicitly, the model is given as 



Jo,i — Jo (> 0), Jo, 2 — Jo, 3 
Ji=0, J 2 = J 3 = J(>0). 



0. 



(3) 



Note that in the model with these parameters the inter- 
actions J2 and J3 are expected to be modified by the 
partial annealing while Ji is kept to be fixed to the pure 
ferromagnetic interaction. A size ratio r between the two 
systems is defined as 



Ni/Nt = 1/r 2 , 

yielding that N x = N/(l + r 2 ) and N 2 
r 2 ) with the total number of spins N 



(4) 

A^r 2 /(1 + 
Ni + A2. 

Two limiting cases r = and r = 00 correspond 
to the Husimi-Tcmperley model and the Sherrington- 
Kirkpatrick model, respectively. 

In the partial annealing system, the interactions J as 
well as the spin variables S are treated as a dynamical 
variable. Time scales associated with J is extremely slow 
and it is assumed that the time scale is separated from 
that of the spin variables. Then, the equilibrium distri- 
bution of the spins at an inverse temperature fts = 1 /Tg 
is given by 



P(S\J) 



1 



Z(J) 



eM-PsH(S\J)), 



(5) 
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where Z(J) is a partition function under a given J. The 
distribution function of J at an inverse temperature (3j = 
l/Tj, different from /3 s, is given by 



mi, and their conjugate parameters <fi, 92 and mi, as 



P(J) = iexp( 



-PjHj), 



(6) 



where is a Hamiltonian of J and Z is the total par- 
tition function. The Hamiltonian of J is generally ex- 
pressed in terms of equilibrium quantities of S and the 
bare distribution Po(J) of Eq. ©. Although the explicit 
form of Hj can be arbitrary chosen, in this study, as in 
[ill fl2| , we set it as 



Hj(J) =F(J)-Tj log P Q (J), 



(7) 



where F(J) is the free energy defined by F(J) = 
-T s \ogZ{J) and P (J) = ft^ P a (J tJ ). 

Then, the equilibrium distribution P(J) and the total 
partition function are rewritten as 



P(J) = ip (J)Z"(J), 
Z = [Z n (J)] , 



(8) 
(9) 



where n is the ratio between two temperatures, n = 
Ts/Tj, and [•••]o means the average over J according 
to the bare distribution P (J). When n = 0, the dis- 
tribution P(J) is identical to Pq{J) and the system cor- 
responds to the quenched one. For finite n and f3j, the 
interactions J with a lower free energy likely occur. 

In the quench limit, the model is reduced to that stud- 
ied by Takayama [2l|, [22[ . The coupled mean-field model 
has been introduced in order to study inhomogeneity of 
interactions between spins in real SG materials pH [22| ■ 
Thus, the previous studies focused attention only on the 
quenched system. In this work, we rather pay attention 
to the system with the partial annealing, in which the 
interactions except for the embedded one in system 1 are 
adiabatically affected by fluctuations of spins. Our main 
purpose is to study the partial annealing effect on the 
stability of the embedded ferromagnetic ordering in the 
system 1 and to clarify characteristics of the resultant 
interactions by the partial annealing. 

The total free energy per spin / at two inverse tem- 
peratures (3s and (3j can be written as 

f(T s , Tj) = lim i log [Z"(J)] . (10) 

PS N^roo iV 

Following the standard procedure of the replica method 
[l|, the quantity [Z n ] is calculated for a positive integer 
n and an analytic continuation to a real value given by 
two temperatures is taken after the calculation. Within 
the assumption of replica symmetry, the free-energy den- 
sity is described in terms of order parameters qi, q 2 and 
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where n p = N p /N (p = 1,2), 773 = N 3 /N and J Dz 
f +oc dz 

J —OO 



72, 



/V2tt. The order parameters follow the 



self-consistent equations, 

J Dz tanh 2 S p cosh™ S p 



and 



q p (T Sl n) 



mi(Ts,n) 



J Dz cosh™ S p 

/ Dz tanh Ei cosh™ Ei 
J Dz cosh" Si ; 



(12) 



(13) 



where Ei = \fqlz + 777,1 and S2 = \fq2z. The conjugate 
parameters, qi, q\ and m l7 are then given by 



qi=/3 s J (rq 2 ), q 2 =f3 s J {qi/r + q 2 ),m 



PsJomi. 
(14) 



By solving the self-consistent equations we have the 
following solutions: paramagnetic solution (qi = q% = 
mi = 0), ferromagnetic one (q± > 0, q 2 > 0, mi > 0), and 
spin-glass one (q± > 0,q 2 > 0,tt7i = 0). The transition 
temperatures between two of the phases corresponding 
to these solutions are given by 



rpFM-SG 

TiPM-SG 
fpPM-FM 

A s 



Mi 



1)91), 



1 + \/5)/2J = y/^J, 



Jo, 



(15) 

(16) 
(17) 



where PM, FM and SG mean paramagnetic, ferromag- 
netic, and spin-glass phase, respectively. The phase 
boundary between the paramagnetic phase and the spin- 
glass one and that between the paramagnetic phase 
and the ferromagnetic one are independent of r and 
77. Thus, the multicritical point located on (Jo/ J, Tg/ 
J) = {y/a, y/a) in the Jq/J — Ts/J plane is independent 
of r and 77. They are consistent with the previous work 
in the quench limit (2lj . 

By following the stability analysis of the RS solutions 
by de Almeida and Thouless (AT) [23| , the stability con- 
dition is derived as 

l-/?|j 2 (l-2 g2 + r2) 

- /3|J 4 (1 - 2q x + ri)(l - 2q 2 + ra) > 0, (18) 
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FIG. 2. (Color online) Phase diagram of a coupled mean- 
field model for (a) r — 1/3 and (b) r = 3 with the ratio 
of two temperatures being n = 2. The notations PM, FM 
and SG mean the paramagnetic, ferromagnetic and spin-glass 
phases, respectively. The points • are the transition temper- 
ature T™' SG obtained by solving the saddle-point equations 
numerically. 



FIG. 3. (Color online) Phase diagram of a coupled mean-field 
model with n = 0.1 for (a) r — 1/3 and (b) r = 3. The 
open and close circles represent the phase boundary between 
replica-symmetry broken (RSB) SG and mixed phases, and 
FM and mixed phases, respectively. The dashed line is a 
boundary between replica symmetric (RS) SG and RSB SG 
phases. 



where 



J Dz tanh S p cosh" 5 p 
J Dz cosh™ S p : 



(P = l,2). 



(19) 



III. RESULTS 

A. Phase diagram 

As shown in the previous subsection, the transition 
temperature T™' SG between the ferromagnetic and spin- 
glass phases depends on the characteristic parameters r 
and n of our model. Here we carefully discuss r and 
n-dependence of the phase boundaries. To completely 
obtain the phase boundary of T™ SG ; we should numer- 
ically solve the self-consistent equations Eq. (fT2|) and 
Eq. (|13l) . Some limit cases around multicritical point 



and near T5 = can be argued by an expansion of the 
order parameters. 

At sufficiently low Tg, the spin-glass order parameters 
q p for p = 1 and 2 behave as 



q p {n) 



1 - 4exp(-2^|j 2 c p (?i - 1)), for n > 1 
exp(-/3|j 2 n 2 c p /2) 



1 - 



(1 - n)0sJJCp~ 



for n < 1, 



(20) 



where c\ — r and C2 = 1 + r 1 . They decrease from 1 
exponentially in fis for n > 1 and linearly in Ts for n < 1 . 
Substituting them into Eq. (JT5JI, we find that T| M SG = 
nJo around Jq = T$ = 0, irrespective of r, and that 
the RS solution at Xg = always satisfies the stability 
condition (fT5|) . Therefore, at Tg = the ferromagnetic 
phase stably exists for any Jo and n > and it vanishes at 
n — 0. The latter is recovered to the quench limit studied 
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in [2l|. At sufficiently low Ts, the partial annealing effect 
yields the ferromagnetic ordering even for weak J and 
for small ratio r by appropriately selecting J2 and J3. 
The stability of the ferromagnetic phase near Tg = is a 
particular feature of the partial annealing system of the 
coupled mean-field model. 

Near the multicritical point, the spin-glass order pa- 
rameters can be expressed as 



92 (™) 



(2 -n)(q-l)(ac 2 -l) 



r 2 ( 



for n = 2, 



(21) 
(22) 



The critical exponent of the spin-glass order parameter 
is 1 at 71 < 2 and 1/2 at n = 2. For n > 2, the order pa- 
rameter is difficult to obtain by an expansion because the 
transition is of first order. The phase boundary around 
the multicritical point significantly depends on r, in con- 
trast to that around Tg = 0. 

The phase diagrams at n = 2 for r = 1/3 and r = 3 are 
shown in Fig. [5] as an example for n > 1 . The obtained 
phase diagram weakly depends on r; for Jq/J > y/a, as 
Tg decreases the transition from the paramagnetic to fer- 
romagnetic phases occurs at T™~ FM , and for J /J< y/a, 
the spin-glass phase appears at T| M SG < Tg < T| M SG . 
All the phases found for n > 1 fulfill the stability con- 
dition (|18j) . In particular, the obtained spin-glass phase 
is correctly described by the RS solution. It would be 
interesting to see that the region of the spin-glass phase 
for r = 3 is reduced as compared with that for r = 1/ 
3. More concretely, the transition temperature T™ sg 
around the multicritical point for r = 1/3 is lower than 
that for r = 3. This is a counter-intuitive result be- 
cause in the case with r = 3 the majority spins in the 
system 2 connect with each other through the spin-glass 
interactions while the majority spins are ferromagncti- 
cally coupled in the system 1 in the case with r = 1/3. 
We shall discuss this point later. 

In addition to the phases found for n > 1, other phases 
appear for n < 1, that are the mixed phase characterized 
by the AT instability with mi > and spin-glass phase 
with replica symmetry brokcn(RSB). The phase diagram 
at n = 0.1 as a typical example for n < 1 is shown for 
r = 1/3 and r = 3 in Fig. [3] The mixed phase is found 
between the ferromagnetic and spin-glass phases and the 
region of the mixed phase is enlarged with increasing r. 
The region of the spin-glass phase is also enlarged with r 
and a broken replica symmetric phase exists in the inter- 
mediate Ts region in the spin-glass phase, in contrast to 
that observed for n = 2. For r = 3, a reentrant transition 
(PM-s>FM->Mixed) occurs at J /J > y/a. Furthermore, 
the transition from the spin-glass or mixed phases to fer- 
romagnetic phase occurs at lower Tg, because the ferro- 
magnetic phase is always stable at Tg = in our model 
for any finite n. Hence, we can see three successive tran- 
sitions, PM->FM-»Mixed-»FM for J /J > y/a. 



B. Reentrant transition 

While a characteristic feature of our model is found 
near Tg = 0, another feature is there around the multi- 
critical point in the phase diagram. As seen in Fig.(3Jb), 
a reentrant transition from the ferromagnetic to a mixed 
and spin-glass phases occurs near the multicritical point 
for Jq/J > y/a. This means that the embedded fer- 
romagnetic ordering of the system 1 described by the 
RS solution becomes unstable as Tg decreases. Such a 
reentrant transition has been already reported for the 
quenched system with n = [2l| . In this work, we study 
a partial annealing effect, namely with finite n, on the 
stability of the embedded ferromagnetic ordering. The 
gradient of Tg at the multicritical point is regarded 

as an indicator of the "reentrant transition" . Namely, the 
negative slope of T s at the multicritical point im- 

plies the existence of the reentrant transition, although 
the existence of a reentrant transition at temperature 
lower than the multicritical point is not completely ruled 
out even in the case with positive slope of T s . 

The reentrant transition can occur when the condition 



dT s 



< 



(23) 



is satisfied where J§(T S ) = T s /(l + (n - l)gi(Tg)) and 
"MCP" means the multicritical point. Note that the or- 
der parameter q\ is a function of Tg. The RS solution for 
qi is sufficient for evaluating the boundary, because the 
RS solution is always stable at the multicritical point. 
From Eq. (|23p . the region of r where the reentrant tran- 
sition occurs is derived as 



r > r c (n), for n < n c ~ 0.8396 . 
where the critical ratio r c (n) is given by 



3 (n) 



(2-n)(l + a) 



2(1 - n)(2a - 1) - (2 - n)(a - 1)' 



(24) 



(25) 



For n > n c , the reentrant transition occurs at r < r c (n) 
with r c (n) being a negative value, hence it is unphysical. 
The derivation of r c (n) is based on the assumption that 
the transition is of the second order. Certainly the tran- 
sition is of second order for n < 2, which is larger than 
n c . Therefore, the reentrant transition occurs only for 
?i < n c . We show 71-dependence of r c (n) in Fig. 2] At 
the smaller n, the reentrant transition occurs at smaller r. 
Eventually, r c takes 1.618 •■ ■ in the quench limit n = 0, 
that is consistent with the results in Ref. [2l|. Further- 
more, it is found that the gradient dJQ(Tg)/dTg at the 
multicritical point is a monotonically increasing function 
of r for n > n c , and this fact yields the shrink of the 
spin-glass phase as r increases, as shown in Fig. [2j Thus, 
the stability of the embedded ferromagnetic ordering of 
the system 1 depends quantitatively on the value of n 
that is a relative temperature /3j//3g. 

Here, we argue a typical feature of the partially an- 
nealed interaction J3 from the obtained phase diagram 
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FIG. 4. n dependence of the critical ratio r c above which 
the reentrant transition can occurs. The ratio r c diverges 
at n c ~ 0.8396 • • • , which is shown by the broken line, with 
increasing n. 

and the critical ratio r c (n). In equilibrium of the par- 
tial annealing system, the interactions J,j are in general 
proportional to n(SiSj) given as a most probable value 
in P(J). Supposing that the order parameter q 2 of the 
system 2 has a finite value at sufficiently low temperature 
Tg, the spins in the system 1 are subjected to an effective 
field r^Jqi caused by the system 2 through the interac- 
tions J3. For n < n c , the interactions J3 are considered 
to be almost random according to the bare distribution 
P(Jq), and hence an effective field is a random field for 
the system 1 . This random effective field also does not fa- 
vor the ferromagnetic order of the system 1, and the spin 
glass phase is enhanced as r increases. As a consequence 
of the competition between r and Jo, the reentrant tran- 
sition at Jo I J > yfa is found at r c . For n > n Cl the 
interactions J3 likely have the same sign as (Si.iS^j). 
Then, the effective field from the system 2 to the system 
1 is not random but it supports the ferromagnetic order 
in the system 1. Therefore, the ferromagnetic ordering is 
stabilized even as r increases and the system 2 with the 
spin-glass couplings dominates. The reentrant transition 
does not occur for any r for n > n c . 



C. local structures of frustration 

In this subsection, we discuss equilibrium properties 
of the coupled mean-field model from the view point of 
interactions J. Frustration is a key quantity that char- 
acterizes a structure of the interactions in spin glasses 
and related random spin models. It is defined as a prod- 
uct of JijS along a minimal loop, whose length is three 
in the fully-connected model studied in this work. If 
the interactions among three spins satisfy the condition 
JijJjkJki < 0, three terms of the local energy cannot be 
minimized simultaneously. Such interactions are called 



to have frustration (24|. Meanwhile, all the interactions 
satisfying JijJjkJki > do not have frustration and the 
energy of the spins attains the global minimum value al- 
though relative directions of spins are not align totally. 
This type of interactions is called Mattis model [2|| and 
all of the interaction sets can be reduced to the pure fer- 
romagnetic model by local gauge transformation Q. 

In the coupled mean-field model, we should consider 
three distinct frustration parameters originated from 
three types of interactions, as shown in Fig. [TJ are de- 
fined; 

^(2) = J2,ijJ2jkJ2,ki, (26) 

i<j<k 

*(3o) — ^l.«J^3,3*;J3,Jfet) (27) 

i<j,k 

^(36) = ^ J3.ijJ2jkJ3.ki- (28) 

i,j<k 

In equilibrium, these parameters are to be taken aver- 
age over the equilibrium distribution P(J) in Eq. © as 
[*(2)]n, [$(3a)]n and [$( 3 f>)]n with [•••]„ being the aver- 
age with respect to J. For the limit n — > with (3s kept 
finite, the distribution P(J) is identical to the bare distri- 
bution Po(J) and the average [■■•]« is reduced to [■ ■ ■ Jo- 
in this limit, the frustration parameters become zero. If 
the frustration parameters take a positive finite value at 
finite n, this indicates that the frustration is decreased 
as a consequence of correlation of J. 

When the bare distribution of the interactions is Gaus- 
sian, the averaged frustration parameters are expressed 
in terms of the order parameters fill [26j. In this model, 
the averaged frustration parameters under the RS ansatz 
are described as follows, 

[*(a)]n = i8|{A| + (n-l)^}, (29) 
[®(3a)]n = P 2 s nj \ 2 m\, (30) 

[*(36)]n = Pli^l + (»» - IV1M2}, (31) 

where X p = 1 + (n— 1)<7 P and fi p = l — q p are the eigenval- 
ues of the n x n matrix Q p whose diagonal components 
are 1 and off-diagonal components are q p . We can also 
derive the frustration parameter with multiple step RSB, 
that does not yield a significant quantitative change (2(| . 

At finite n, [3>(2)]n and [$(3&)]n take a finite value de- 
pending on /3g, while [$(3 a )] ra zero in the paramagnetic 
phase. This moderate decrease of the frustration is con- 
sidered to be due to an emergence of "short-range" cor- 
relation of J induced by the partial annealing. A consid- 
erably qualitative change of the frustration parameters 
is accompanied by phase transitions. In the spin-glass 
phase with q± > 0, q 2 > and mi = 0, the frustra- 
tion parameters [$(2)]n and [$(36) } n largely increase, but 
[3>(3a)]n is still zero. Therefore, the frustration is non- 
uniformly distributed in the system and a "local" struc- 
ture of frustration is formed; the frustrations in the sys- 
tem 2 and a part of J3 decrease, but a remaining part of 
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J% has frustration as much as the randomly constituted 
interactions. The local structure prefers to decrease se- 
lectively the frustration of the system 2 in the spin-glass 
phase, and does not cooperative with the ferromagnetic 
state of the system 1. Meanwhile, all of the frustration 
parameters take a positive value in the ferromagnetic 
phase, because in this phase all order parameters are fi- 
nite. In this case, all interactions Ji and J3 decrease the 
energy of the ferromagnetic state of the system 1, mean- 
ing that the effective field from the system 2 energetically 
supports the ferromagnetic state of the system 1. This 
typ e of interactions is similar to that of the Mattis states 
|25(. These observations of the frustration parameters 
certify the validity of the argument of r c (n) and n c in 
the previous section. 

Before closing this section, we discuss the order of the 
frustration parameters. The interactions are of order of 
7V~ 1//2 in the bare distribution. When the frustrations 
completely vanish with keeping the order of J^ , the or- 
der of the frustration parameters become 0(N 3 / 2 ) by 
definition. However, the averaged frustration parame- 
ters should be O(l) quantities for any Tg, as seen from 
the expressions Eq. (J2U), Eq. (001) and Eq. §T$. This 
means that the order of JijS is appropriately modified to 
0(N^ 1 ) through the partial annealing, and the extensiv- 
ity of thermodynamic quantities such as energy and free 
energy is maintained at whole temperature region. It is a 
characteristic of the partial annealing with the bare dis- 
tribution function of J being Gaussian. When the bare 
distribution is bimodal and the allowed value of J is re- 
stricted to ± J, namely ±J model, the order of Jy cannot 
be changed and the energy becomes 0(N 3 ' 2 ) in the resul- 
tant ferromagnetic phase, that is the lack of extensivity. 
We should be careful for the study of thermodynamics in 
such models. 



IV. SUMMARY AND DISCUSSION 

We have studied equilibrium properties of the cou- 
pled mean-field model in the partial annealing system, 
in which the system 1 with an embedded ferromagnetic 
ordering and the system 2 with no embedded pattern 
are coupled with spin-glass interactions. In this model, 
the interactions as well as spins are regarded as dynam- 
ical variables, but their time-scales are completely sep- 
arated from each other. The spins S and interactions 
J touch to their own heat bath with different tempera- 
tures Ts and Tj. By using the replica method, the free 
energy of the system is derived as functions of the two 
temperatures, and the phase diagram is obtained in the 
two-temperature plane. The phase boundary between 
the ferromagnetic phase and the spin-glass phase inter- 
estingly depends on the model parameters, the size ratio 
r of the system 2 to the system 1 and the ratio n between 
two temperatures. 

We carefully studied T™~ SG around the multicritical 
point. It is found that there exists a critical value n c in 



the ratio n, which characterizes if the reentrant transition 
occurs around the multicritical point. For n < n c , the 
partial annealing effect on the inter-coupling J3 is not sig- 
nificant to enhance the embedded ferromagnetic ordering 
in the system 1. The effective field from the system 2 to 
the system 1 does not support the ferromagnetic ordering 
in the system 1. Therefore for a fixed n < n c as the ratio 
r increases, in other words the number of spins in the sys- 
tem 2 increases relatively, a competition about the ferro- 
magnetic order is expected; the random filed destabilizes 
the ferromagnetic order and the coupling Jo stabilizes it. 
As a result of the competition, the ferromagnetic order is 
destabilized eventually. This can be seen as the reentrant 
transition in the phase diagram. Meanwhile, for n > n c 
the effective field supports to achieve the ferromagnetic 
ordering in the system 1 irrespective of the value of r, 
and the spin-glass region is narrowed monotonically as r 
increases. 

We introduced three frustration parameters, < &(2), 
5?(3o) an d $(36) for characterizing partially annealed in- 
teractions of the coupled mean-field model. They are 
expressed in terms of the order parameters of the spin 
system in equilibrium. Using the parameters, we classify 
the type of the interactions in this model into three cat- 
egories, that correspond to each phase; interactions with 
a local structure of frustration in the spin-glass phase, 
Mattis-like interactions in the ferromagnetic phase, and 
randomly constructed interactions in the paramagnetic 
phase. The characteristic interactions found in the spin- 
glass phase do not cooperatively support the ferromag- 
netic ordering of the system 1, that is to say, the frus- 
tration is eliminated from the system 2 independently of 
the ferromagnetic interactions in the system 1. 

This is quite different from those obtained in a related 
model previously studied @,@], in which a locally embed- 
ded pattern is supported by the interactions surrounding 
the pattern and the frustration in the rest of the inter- 
actions still remains extensively. Although both models 
have the same structure that an ordering pattern is em- 
bedded in a part of the system, the partial annealing 
leads to the different property of interactions; the in- 
teractions in the previously studied model support the 
embedded pattern, and those in this study disturb it. A 
reason of the difference may be originated from the dif- 
ferent choice of Hj. In the present work, 7Jj(J) contains 
the spin free energy, while Hj(J) in @, Si has a local or- 
der parameter. The results suggest that an explicit form 
of Hj(J) strongly affects on the construction of the in- 
teraction J and the ordering of the spin S, in particular, 
an entropic effect of J is nontrivial. For proper under- 
standing of the constructed interactions in the partial 
annealing, we have to pursue some variant models with 
a general type of Hj. However, analytical studies of the 
partial annealing to this time heavily relies on the replica 
method, that is applicable to only systems with the spin 
free energy as Hj. The partially annealed system with 
Hj that does not contain the spin free energy has yet to 
be revealed in terms of spin-glass theory. An extended 
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formalism of the partially annealed system is required for 
further applications to biological or engineering models. 

In this work, we focus our attention to the mean-field 
analysis based on the fully connected spin models. When 
we introduce a diluted model such as the Viana-Bray 
model [27l ] in partial annealing, the geometric structure 
of the partially annealed J may play an important role 
in cooperative phenomenon. Furthermore, a decoupling 
transition of two degrees of freedom might occur in the 
diluted models, while the transition of frustration is com- 
pletely correlated to the transition of the spin variables 
in our model. Some work in this direction is in progress. 

We end with an account of a perspective of the par- 
tially annealed system. In most of the studies concerned 
with the partial annealing, the free energy is used for 
Hamiltonian Hj(J) of the slow variables J. This yields 
a replicated system with a finite replica number deter- 
mined by the ratio of two temperatures in the partially 
annealed system. The partial annealing can be consid- 
ered to give a physical meaning to the replica approach 
before taking a limit of the replica number to zero 
Meanwhile, the large deviations of the free energy of 
mean-field spin glasses are studied by the replica method 



with a finite replica number [28j . A mechanism of replica 
symmetry breaking is studied through a pha se transition 
as the replica number is taken to zero [29j. Thus, the 
study of finitely-replicated system can provide new in- 
sights into the spin-glass theory. In this work, we dis- 
cussed a phase transition as a cooperative phenomena of 
the fast and slow variables with the replica number vary- 
ing, that might give a different viewpoint to the finitely 
replicated system. It would be interesting to classify 
possible universality classes of phase transitions of the 
finitely replicated systems, particularly in finite dimen- 
sions. 
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